SCIENTIFIC 

REPpRTS 




OPEN 



SUBJECT AREAS: 
DISPLAYS 

ELECTRICAL AND ELECTRONIC 
ENGINEERING 

APPLIED PHYSICS 



Received 
20 May 2014 

Accepted 
/August 2014 

Published 
22 August 2014 



Correspondence and 
requests for materials 
should be addressed to 
H.S. (sasaki@nict.go.jp) 



Large size three-dimensional video by 
electronic holography using multiple 
spatial light modulators 

Hisayuki Sasaki, Kenji Yamamoto, Koki Wakunami, Yasuyuki Ichihashi, Ryutaro Oi &Takanori Senoh 

Universal Communication Research Institute, National Institute of Information and Communications Technology, 
4-2-1 Nukui-kitamachi, Koganei, Tokyo 1 84-8795, Japan. 

In this paper, we propose a new method of using muhiple spatial Ught modulators (SLMs) to increase the size 
of three-dimensional (3D) images that are displayed using electronic holography. The scalability of images 
produced by the previous method had an upper limit that was derived from the path length of the 
image-readout part. We were able to produce larger colour electronic holographic images with a newly 
devised space-saving image-readout optical system for multiple reflection-type SLMs. This optical system is 
designed so that the path length of the image-readout part is half that of the previous method. It consists of 
polarization beam splitters (PBSs), half- wave plates (HWPs), and polarizers. We used 16 (4 X 4) 
4KX 2K-pixel SLMs for displaying holograms. The experimental device we constructed was able to perform 
20 fps video reproduction in colour of full-parallax holographic 3D images with a diagonal image size of 
85 mm and a horizontal viewing-zone angle of 5.6 degrees. 

The spatial image reproduction three-dimensional (3D) display methods can display natural 3D images. They 
can reconstruct spatial images in a similar manner to when objects are being directly observed. These 
methods can be achieved using integral photography^"^ or holography. Integral photography is a method 
that reproduces discrete light rays from objects. Electronic holography is considered to be the ideal and ultimate 
3D video display method since it can reconstruct the wavefronts of the light reflected by objects and propagated 
through space. There exist advantages and disadvantages of each method. It is desirable for both the image size of 
a 3D image and the viewing-zone angle to be large. However, there exist many technical problems to overcome. 
One of the most important problems remaining to be solved for electronic holography is enlargement of the 
image size. 

A wide range of research has been conducted concerning 3D displays using electronic holography for repro- 
ducing 3D videos. This includes research directed towards increasing the image size^"^ and research directed 
towards real-time operation using conventional central processing units (CPUs)^ or graphics processing units 
(GPUs)^"^° for hologram calculations. 

Various methods for increasing the viewing zone by using space-division multiplexing have been proposed^ 
These methods are affected by the problem that part of the viewing-zone angle is missing. To overcome this 
problem, a method has been proposed that uses a beam splitter and multiple spatial light modulators (SLMs)^^. 
However, the viewing-zone angle is scalable only in the horizontal direction, and each of the gaps between SLMs 
must equal the width of an SLM. 

On the other hand, various methods of increasing the image size by using space-division multiplexing have also 
been proposed. Some problems with these proposals are that they only provide parallax in the horizontal 
direction^^'^^, the image size is only scalable in the horizontal direction^^, or high-refresh-rate SLMs are required 
because the display frame rate is inversely proportional to the space- division multiplexing count^^ 

In a previous paper, we proposed a method of increasing the image size using space- division multiplexing by 
locating an optical system containing a lens array and other components in front of multiple SLMs^. Various 
methods of colourizing reconstructed images by using space-division multiplexing have been proposed^^"^^. 
Although these methods achieve ideal colourization of the reconstructed 3D images without colour breakup, 
they are too complex to adapt to the multiple-SLM system mentioned above because they will require triple the 
number of SLMs than in a monochromatic system for static colourization and they will also require a large or 
complex combination of optical systems. We proposed a colourization technique^^'^^ based on time- division 
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multiplexing^^ using three lasers (i.e., red, green, and blue) and a set 
of three revolving wheel shutters synchronized with 60 Hz driven 
SLMs. 

However, a problem with the method mentioned above is the 
increased size of the image-readout optical system caused by increas- 
ing the number of SLMs to obtain a larger image. The enlargement of 
this assembly in the direction of the SLM's surface is acceptable, but 
the enlargement in the direction of its optical axis causes a problem. 
The proposed method can be scaled to increase the number of SLMs 
for further enlargement of the image, but there exist three factors 
limiting the image size. Firstly, the sizes of the lenses, secondly, the 
physical path length between SLMs and lenses to install the image- 
readout optical system, and thirdly, vignetting of the first- order dif- 
fraction beam by the outer edge of the polarization beam splitter 
(PBS) that was located at a distance from the SLMs. A solution for 
the second and third problems is to reduce the number of PBS steps 
to shorten the path length in the image -readout optical system. 

In this paper, we propose a method of producing larger colour 
electronic holographic images with a newly devised space-saving 
image-readout optical system for multiple reflection-type SLMs. 
This optical assembly is designed so that the physical path length 
of the image- readout part is half that of the previous method and 
larger number of SLMs can be tiled. We apply this method with 16 (4 
X 4) 4KX2K-pixel SLMs to display larger full-parallax colour holo- 
graphic 3D video than with the previous system^^'^^. 

Results 

Limitation of the number of PBS steps in the image-readout 
optical system. Figure 1 shows the configuration of the developed 



optical systems and their experimental setup and Table 1 shows a list 
of parameters. They are examples of the case when the horizontal 
number of SLMs is four. Time-divided colour parallel light from a 
coherent light source as shown in Figs. 1(a) and 1(c) is incident 
perpendicularly on SLMs through PBSs D"'(m = 1,2, • • • ,K^) in 
Figs. 1(b) and 1(d). Note that the superscript of the letter represents 
the location within the array. Figures 1(a) and 1(b) show plane 
figures of the optical systems in the horizontal direction. 
Consequently, this is so-called in-line holography. Amplitude 
modulation (AM) type reflective SLMs are used for displaying 
hologram data. This kind of SLM creates modulation from the 
polarization rotation of incident light that corresponds to the input 
signals. Therefore, the combination of the SLM and each 
corresponding polarization- selective device (such as a PBS) results 
in the AM output of the light. The hologram data displayed on are 
synchronized with the wheel shutters and changed to accommodate 
the alternating wavelengths of the light sources (i.e., red, green, or 
blue) every 1/60 second. Since the pixels are arranged in a grid 
pattern on a thin hologram, the light reflected on C"" contains a 
primary beam (first-order diffraction beam), conjugate beam 
(minus first-order diffraction beam), carrier beam (zero-order 
beam), and high-order diffraction beams of each of them. Since the 
object beam is generated as a primary beam, the other beams are 
unnecessary light and must be eliminated. 

In the previous system, an image-readout optical system as shown 
as Fig. 2(a) was used. PBSs are installed in a step-wise manner. We set 
the physical path length a and the geometrical path length a', which 
was optically compensated by the refractive index of the PBS, 
between C"" and lenses as follows: 
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where Hd is the relative refractive index of the PBS material for air. 
The sizes (width and depth) of the PBSs are ^D-fi and/2 are the focal 
lengths of lenses and L^, respectively. Equation (1) indicates that 
a' equals the sum of a and the optical effect from the difference of the 
refractive index caused by a PBS in the optical path. The limitation of 
the number of PBS steps that is limited by a is necessary to satisfy 
the following relation: 



a>/Da^D- 



(2) 



The thickness of the polarizers and lenses and the difference of 
according to wavelength play only small or negligible roles. 

On the other hand, when the number of SLMs increased, the PBSs 
in the outer positions produce the vignetting angled part of the read- 
out light from the corresponding SLMs (i.e., light with an angle 
between the zero- and first-order diffraction beams). To avoid this 
vignetting by the outermost PBS, limitations of the number of PBS 
steps /djc and l^y, which depend on the vignetting limits of the hori- 
zontal and vertical directions, respectively, are necessary to satisfy the 
following relations: 



>2{Idx + 1/^d - 1) fetan^ix + Si, 
^ (fo^ + V^D - 1) c^Dtan^i^ + Sy, 



(3) 
(4) 



where the height of the PBSs is f]^, and the sizes (width and height) of 
the SLMs are denoted by Si and Sy. The angles of the first-order 
diffraction beam Oi^ and Oiy are given as follows: 



Oix = arcsm ^ 



2px 2px ' 



iiy = arcsm z — ^ - 



2py 2py ' 



(5) 



(6) 



where the horizontal and vertical pixel pitches arep^^ ^ndpyy and the 
wavelength of the reproduced light is denoted by L Therefore, the 
overall limitation of the number of PBS steps l^, which depends on 
either the effect of the physical path length a (derived from/i and/2: 
cf formulas (1) and (2)) or vignetting of the first-order diffraction 
beam by the outermost PBS (cf. formulas (3) or (4)), is given as 
follows: 



= min(| f 11 ^ 



tan^i 



1 

no 



J Lc^Dta 



tan^ii 



1 

no 
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where the notation [-J indicates the floor function. is equal to the 
limitation of the horizontal number of PBSs by the optical system in 
Fig. 2(a). 

When f\Y) equals c^dj the contribution to by the effect of hori- 
zontal direction /djc is more dominant than the effect of vertical 
direction l^y in equation (7) because Si is larger than S'y and Oi^ 
equals Oiy in most cases. Furthermore, /oa^ which depends on a, 
has enough margin to install PBSs in a step-wise manner if we set 
the values of/i and/2 appropriately. It is clear from formulas (1) and 
(2) that we can easy to enlarge /^a by elongation of/i. Therefore, it 
can be said that most effective parameter in equation (7) is /dx- 

The relations between c^d and the limitation of the horizontal 
number of PBSs determined by /d are drawn as graphs in Fig. 3, 
where the above-mentioned parameters are selected as the values 
shown in Table 1. The dark gray shaded area shows feasible numbers 
of PBS steps. When PBSs with size c^d — — 28 mm are used, the 
upper limit of the number of steps is three and it is clear that we 
cannot arrange four PBSs with four steps regardless of whether we 
would like to arrange the SLMs 4 X 4 in a plane. 

To overcome the limitation of image size scalability, it is necessary 
to increase the gap T between SLMs and use a large PBS, or to divide 
the beam from the light source and make it incident from multiple 
directions (e.g., enter from opposite sides) to reduce the number of 
PBS steps as shown in Fig. 2(b). However, the first method men- 
tioned in the previous sentence necessitates huge optical components 
in the following optical system. For example, if we use PBSs with size 
c^D ^ 35 mm so that the upper limit of the number of steps is as high 
as five, the physical sizes of lenses L^ and L3 (i.e., f]2, and (/>3) 
would have to be L25 times larger than the values shown in Table 1. 
Furthermore, the second method requires many optical components 
to create a complex incident light path. These methods are feasible 
but difficult or complicated. 

Therefore, we devised an optical system in which illumination 
light is enterable from only one direction and the number of PBS 
steps can be halved. Figures 2(c) and 2(d) show its composition. The 
limitation of the horizontal number of PBSs by the optical systems in 
Figs. 2(b)-2(d), which is also drawn as graphs in Fig. 3, is expressed as 
2/d because there exist two PBSs in the horizontal direction for every 
one step of PBSs in the depth direction. The light and dark gray 



Table 1 | System parameters 
Parameter 



Design value 



Wavelength of lasers (/Ir, Xq, Aq) 

Number of pixels for each SLM (horizontal N^, vertical Ny) 

Pixel pitch for each SLM (horizontal px, vertical py) 

Image size for each SLM 5' (horizontal S'x, vertical S'y) 

Viewing-zone angle for each SLM (horizontal 9x, vertical 0y) 

Number of SLMs /C (horizontal Kx, vertical Ky) 

Gap between adjacent SLMs V (horizontal T^, vertical Ty) 

Size of PBS (width and depth ^0, height rjo) 

Relative refractive index of PBS material for air no 

Lens Lo (focal length fo, diameter 0o) 

Focal lengths of lenses Lj" (f^, f-\ -\, f-\2) 

Size of lenses L^ (horizontal ^-\, vertical ^1) 

Size of apertures in spatial filters F"" (horizontal vertical ^f) 

Lenses L^ (focal length horizontal size ^2, vertical size ^2) 

Lens L3 (focal length f^, diameter ^s) 

Lens L4 (focal length f4, diameter ^4) 

Hologram data update rate 



(633,532,473) [nm] 
(3840,2160) [pixels] 
(4.8,4.8) M 

Diagonal 2 1.1 (18.4, 10.4) [mm] 
(5.6,2.8) [degrees] 
1 6 (4, 4) 

(33.2, 18.7) [mm] 
(28, 28) [mm] 
1.52 

(600, 200) [mm] 
(125, 170, 476) [mm] 
(45, 29) [mm] 
(12.4,6.2) [mm] 
(350,51.6,29.0) [mm] 
(800, 340) [mm] 
(285, 130) [mm] 
60 [fps] 
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Figure 2 | Image-readout optical systems. AM type reflective SLMs without polarization filters are used for displaying hologram data. Combination of 
the SLM and each corresponding PBS makes AM output of the light. The PBS in the outer position of conventional image-readout optical system 
produces the vignetting angled part of the readout light from the corresponding SLM (a). Illumination light enters from multiple directions 
(e.g., enters from opposite sides) to reduce the number of PBS steps (b). However, this system requires a complex incident optical system. Newly devised 
image-readout optical system, which consists of pairs of PBSs, SLMs, HWPs, and polarizers (c), and its operating principles (d). The PBS and 
SLM at odd-numbered positions are D° and C°, and at even-numbered positions are D"" and The number of PBS steps can be halved with illumination 
light entering the PBSs from a single direction. 



shaded areas in Fig. 3 show feasible regions of the horizontal number 
of PBSs in this instance. 

Experimental setup. We constructed a device with the parameters 
shown in Table 1 . We used a combination lens as to reduce optical 
distortions. The focal lengths of the individual lenses V^^ and 

are denoted by/n and/12, respectively. This device, which uses 
an optical system and 16 SLMs, corresponds to an SLM with approxi- 
mately 133 megapixels. We used AM type 4KX2K-pixel reflective 
liquid crystal on silicon (LCOS) SLMs^^'^^ that are manufactured by 




0 20 40 60 80 100 120 



Size of PBS [mm] 

Figure 3 | The relations between the size of PBS and the limitation of 
the horizontal number of PBSs (fi = 125 mm, ^ = 350 mm, = 1.52, 
= S'x = 18.4 mm, Sy = 10.4 mm, = py= 4.8 /mi, and 2 = 2^ = 
473 nm). The dashed lines show the relations of ^y) to (green line), 
which is the limitation by the path length a, /^x (blue line), which is the 
limitation by the vignetting limits of the horizontal direction, (red line), 
which is the limitation by the vignetting limits of the vertical direction, and 
/d (upper bound of gray shaded area), which is the overall limitation, by the 
conventional optical system shown in Fig. 2(a). The solid lines show the 
relations of to 2/0^, 2/^^, 2/^^, and 21^ by the space-saving optical 
systems shown in Figs. 2(b)-2(d). 



JVC KENWOOD Corporation. Figures 1(c)- 1(e) show the 
experimental setup. We performed the following experiments 
using hologram data created by computer-generated holography 
(CGH) technology. Note that in this device, the horizontal and 
vertical gaps between adjacent SLMs Ti and Ty are 1.8 times the 
image size of each SLM Si and Sy due to physical constraints of the 
SLMs. In other words, for a display area of 1 for the image part, the 
area of the missing segments is approximately 4.5. 

Experiment testing image-readout optical system. We operated the 
rotatable half- wave plates (HWPs), which are installed on light paths 
from every colour laser (cf. Figs. 1(a) and 2(d)), to control the ratio of 
the s- and p-polarized light that is incident on the PBSs. We defined 
the rotation angles of the HWPs i/^r, iI/q, and i/^b to be 0 degrees when 
the flluminated SLMs of C are brightest and the illuminated SLMs of 
C° are darkest. When the HWPs are rotated untfl C^ and C° have 
equivalent brightness, i/^r, xJ/q, and ij/^ become 24, 20, and 23 degrees, 
respectively. Furthermore, when they are rotated until the C^ are 
darkest and C° are brightest, i/^r, iI/q, and i/^b become 45, 44, and 
45 degrees, respectively. Figure 4 shows the experimental results in 
each colour channel. From these results, we confirmed that the 
devised optical system is able to illuminate the SLMs from a single 
direction, the number of PBS steps can be halved, and the intended 
function of the image- readout is achieved. 

Experiment displaying 3D images. We confirmed that objects with 
different depths could be reconstructed in colour by using time- 
division multiplexing. Figures 5 and 6 show colour 3D images that 
are displayed by this system. Figures 5(a) and 6(a) show the design 
values of the displayed objects. The displayed hologram data was 
calculated by using the ray-sampling (RS) plane approach^^ In this 
approach, the RS plane is virtually set near the object and the dense 
ray information is sampled and converted into the wavefront on that 
plane as the Ray- Wavefront conversion process^^. The light field on 
the hologram plane is then obtained by a two-dimensional (2D) light 
propagation calculation from the given RS plane to the hologram 
plane. The dense ray information was rendered as a set of projection 
images by general computer- graphics (CG) software. 

The photographs in Figs. 5(b), 5(c), and 5(d) were taken from a 
location directly in front, a location determined by pointing 2.8 
degrees right, and a location obtained by pointing 2.8 degrees left. 
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Figure 4 | Control of incident light distributions using rotatable HWPs in each colour channel. The illuminated SLMs of O (i.e., and C^) are brightest 
and the illuminated SLMs of C° (i.e., and C^) are darkest and the rotation angles i/^r, ipQy and ipB of the HWPs are defined as 0 degrees (a); the 
HWPs are rotated until C and C° have equivalent brightness (b); and they are rotated until the C are darkest and C° are brightest (c). 



respectively. A logotype of NICT is located at 113 mm, the left front 
wheel of a car is at 118 mm, the left rear wheel is at 143 mm, and a 
Venus statue is at 120 mm behind the hologram plane, respectively. 

The photograph in Fig. 6(b) was taken of the reconstructed 
objects focused on the hologram plane, the photographs in 
Figs. 6(c) -6(e) were focused on the logotype of NICT, and the 
photographs in Figs. 6(f) -6(h) were focused on the background 
object. Figs. 6(b), 6(d), and 6(g) were taken from locations directly 
in front; Figs. 6(c) and 6(f) were taken by pointing 2.8 degrees 
right; and Figs. 6(e) and 6(h) were taken by pointing 2.8 degrees 
left. The logotype of NICT is located at 100 mm, and the back- 



ground object is 200 mm behind the hologram plane. When the 
objects can be reconstructed at different depths, the background 
object should be blurry in Figs. 6(c)-6(e), and the logotype of 
NICT should be blurry in Figs. 6(f) -6(h). From the experimental 
results and the description above, it is apparent that objects with 
different depths can be reconstructed. 

The photographs in Figs. 5 and 6 also show the views of the same 
displayed objects from other angles. It is apparent that the recon- 
structed objects can be observed in the designed viewing zone and 
missing segments that can be seen without the optical system are 
eliminated. 



RS plane 




Figure 5 | Experimental results. Design values of the displayed objects in the experiment (a) . A logotype of NICT is located at 11 3 mm, the left front wheel 
of a car is at 118 mm, the left rear wheel is at 143 mm, and a Venus statue is at 120 mm behind the hologram plane, respectively. Photographs that 
were taken from locations directly in front (b), taken by pointing 2.8 degrees right (c), and 2.8 degrees left (d). K.W. prepared hologram data. H.S. took the 
photographs. 
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Figure 6 | Experimental results. Design values of the displayed objects (a). Photographs that were taken of the reconstructed objects focused on the 
hologram plane (b), focused on the logotype of NICT (c)-(e), and focused on the background object (f)-(h). Photographs (b), (d), and (g) were taken 
from locations directly in front; (c) and (f) were taken by pointing 2.8 degrees right; and (e) and (h) were taken by pointing 2.8 degrees left. K.W. prepared 
hologram data. H.S. took the photographs. 



We also confirmed that a video could be reproduced. Figure 7 
shows the experimental results. We used CGH technology to create 
hologram data for the earth and letters. The letters circle around the 
earth. The logotype of NICT is located at 104 mm, and the centre of 
the earth is 127 mm behind the hologram plane. This experiment 
confirmed that this video sequence could be converted to a frame rate 
with one set of red, green, and blue per frame in time-division colour 
and played smoothly at a 20 fps (frames per second). 

The displayed size of these 3D images is 74 mm X 42 mm (i.e., the 
diagonal is 85 mm) and the viewing-zone angles are 5.6 degrees 
horizontally and 2.8 degrees vertically. From the experiments 
described above, it is apparent that a colour-moving image of 3D 
objects having an image size of 16 times that of an SLM can be played 
with a frame rate of 20 fps using the proposed method. 

Figures 5-7 show that gaps between the SLMs are eliminated. 
However, the boundaries of the SLMs are observed. In addition, 
differences of brightness are observed between each small display 
area. 



Discussion 

In this paper, we propose a method of producing larger colour elec- 
tronic holographic images with a newly devised space-saving image- 
readout optical system for multiple reflection -type SLMs. We applied 
the proposed method to 16 SLMs to realize full-parallax video holo- 
graphy at a frame rate of 20 fps with an image size of 16 times that of 
one SLM and a viewing-zone angle of 5.6 degrees. Although the time- 
division colourization method had a frame rate of 20 fps because we 
used 60 -fps SLMs, we could also reach 60 fps in colour, for example, 
if 180-fps SLMs were used. 

When observing a 3D image with the focus on a distant location 
from the hologram plane in the depth direction, the boundaries of the 
SLMs become diffuse and sparse because these boundaries exist on 
the hologram plane. Actually, the observed boundaries are sparser in 
Figs. 6(f)-6(h), which are focused on the background object located 
far from the hologram plane, than the boundaries in Figs. 6(c)-6(e), 
which are focused on the logotype of NICT located near the holo- 
gram plane. 



^^^^ 



RS plane 



Hologram plane 



74 mm 



100 mm 
(a) 



Figure 7 | Experimental results. Design values of the displayed objects (a) and reconstructed 3D image at video rate (b) . The centre of the earth is 27 mm 
behind the RS plane. K.W. prepared hologram data. H.S. took the photograph. 
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Differences of brightness exist depending on the difference of 
contrast between each display area in Figs. 4-7. Since there is no 
difference of contrast among SLMs, we think that differences among 
the optical specifications of the various PBSs that comprise an incid- 
ent optical system become the dominant influence. Since each PBS 
provides a different contrast, this produces a detrimental effect for 
viewing the 3D image. We believe that we can balance the differences 
of display brightness among the various display areas if we compens- 
ate for luminance differences among the hologram data that is dis- 
played on the various SLMs. 

Methods 

space-saving image-readout optical system. Figures 2(c) and 2(d) show the space- 
saving image-readout optical system and its operating principles. Rotatable HWPs 
are inserted in the light paths from every colour laser because light in which s- and p- 
polarizations are mixed with the intended ratio is to be incident on the PBSs. We use 
pairs of PBSs. We denote a PBS and SLM at odd-numbered positions here by D° and 
C° and at even-numbered positions by D*" and C in a pair of PBSs and their 
corresponding SLMs, respectively. D° and D*" are arranged in tandem for the incident 
light path, and a HWP is fixed between these PBSs. The s-polarized component of the 
incident light is reflected by the mirror (e.g., dielectric multilayer mirror, wire grid, 
etc.) in D° and illuminates C°. The p-polarized component passes through D° and is 
converted to s-polarized light by the HWP. This light is incident on and reflected by 
D"" so that it then illuminates C^ 

Readout light from each SLM consists of mixed polarization light because the s- 
polarized incident light changed to the p-polarized component of the readout light, 
and this conversion ratio depends on the displayed value of each pixel. Only the p- 
polarized component of the readout light passes through the PBS and polarizer and is 
then output from this image-readout optical system. The s-polarized component 
from the SLMs is reflected by the PBSs and goes back towards the light source. The 
light that goes back to D° from D*" is also converted to p-polarized light by the HWP 
and goes straight through D° ideally. However, there exists a possibility of crosstalk 
interference by a small quantity of a residual s-polarized component. The polarizer 
next to D° cuts off this s-polarized component. Essentially, a polarizer does not have 
to be set next to D^ but we use it for luminance equalization of the D° and D*" optical 
outputs. Since the modulation type of the SLMs is AM as mentioned previously, 
polarizers after the PBSs will not affect the modulated wavefront of holograms. 

The loss of light that passes through D*" is greater than the loss of light that only 
passes through D° because it takes a longer path and also has to pass through the 
HWP. There exists a possibility of incomplete conversion in the HWP due to wave- 
length differences, which also leads to a loss of light in D''. To compensate for these 
effects, rotatable HWPs are installed in the light paths from every colour laser as 
mentioned above. These HWPs can be rotated to control the ratio of the s- and p- 
components of the incident light and to compensate for luminance differences in the 
D° and D*" optical outputs of every colour. Essentially, rotatable HWPs do not have to 
be set if the corresponding laser equipment is rotatable around each optical axis and 
fixable at intended attitudes, but we use them to facilitate adjustments of polariza- 
tions. The optical systems in Fig. 1 utilize this method. 

Image size and viewing-zone angle. If we denote the number of SLM pixels here by 
Nx and Ny and the pixel pitch in the horizontal and vertical directions by px and py, 
respectively, then the image sizes and Sy and the horizontal and vertical viewing- 
zone angles 6^ and 6y are given as follows: 

Sx = NxPx, (8) 

Sy=NyPy, (9) 

e,=2eix, (10) 

0y = 9,y, (11) 

where the horizontal and vertical angles of the first-order diffraction beam Oi^ and Oiy 
are given by equations (5) and (6). With the space- division multiplexing method, if we 
denote the number of pixels in the horizontal and vertical directions of each SLM by 
N'x and Ny and denote the number of SLMs by Kx and Ky, then Nx = N'xKx and 
Ny = NyKy. Thc Only difference between the horizontal and vertical directions is the 
viewing-zone angles Ox and 6y. 

Light source optical system and colourization. Figure 1(a) shows the light source 
optical system that implements colourization based on time-division 
multiplexing^^'^^. This is also known as the frame sequential method. This system 
consists of three lasers (i.e., red, green, and blue), rotatable HWPs, wheel shutters, 
spatial filters, and a trichroic prism assembly. The shutters are rotating wheels driven 
by motors that are synchronized with the SLMs and controlled so that a beam of one 
of the three colours is selected to pass through the shutter every 1/60 second. After 
that, the laser beams pass through a spatial filter (i.e., convex lens and pinhole) so that 



the shape of the beams gradually becomes wider. Three beams are combined into one 
by a Phillips type trichroic prism assembly. Finally, the combined white beam is 
coUimated by a large size convex lens Lq to illuminate all of the SLMs. 

Gap reduction optical system. Figure 1(b) shows the image-readout and gap 
reduction optical systems. Emitted light from the image-readout optical system is 
incident on lenses Lf, spatial filters F™, and lenses L^^. Spatial filter F"" is located on 
the common focal plane Pi of lenses L^ and L^, and the focal length/i of L™ and focal 
length /2 of LJ' are related as follows: 

depending on the image size S' of each SLM and the gap V between SLMs. Also, we 
set the physical path length a and the geometrical path length a', which was optically 
compensated by the refractive index of the PBS, between C™ and lenses L^ as shown in 
equation (1). This enlarges the image due to by (S' + r')/S' and shifts it to L^ (P2). 

The missing image segments due to the gaps between the SLMs will disappear. The 
group of lenses L^ and L^ forms the lens arrays, respectively. is a spatial filter array 
for eliminating the conjugate beam, carrier beam, and high-order beams, which are 
unnecessary light^^. Finally, the light is incident on lens L3 and lens L4. By setting the 
focal length /3 of L3 and focal length /4 of L4 as follows: 

/.= (^)/3. (13) 

the image that had been enlarged at P2 will be returned to its original size at plane P3. 

This optical system can exhibit parallax in both the horizontal and vertical direc- 
tions. However, as shown in equations (10) and (11), the horizontal viewing-zone 
angle Ox is two times the viewingzone angle of the first-order diffraction beam Oix, but 
the vertical viewing-zone angle 6y equals Oiy. The reason for this is that spatial filters 
F"" eliminate the first-order diffraction beam in the lower side of the vertical direction 
to eliminate the conjugate image, i.e., single- sideband holography^** with half- zone- 
plate processing is performed for the hologram data that is displayed on the SLM^^. 
We used spatial filters F™ as shown in Fig. 1(b). A mask (gray square with white 
rectangle aperture) shows a plane figure of the configuration of the spatial filter in the 
vertical direction. The aperture sizes in horizontal and vertical directions of spatial 
filters c^F and rj^; are given as follows: 

c^F = 2/itan0i^, (14) 
rj^ =fi tan 9iy. (15) 

The conjugate beam and carrier beam are eliminated by the dashed lined rectangle 
part in the masked area, and the other masked area eliminates the high-order beams. 
Only the object beam passes through the aperture selectively. 
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